Method and system to control the focus depth of projected images

ABSTRACT

Methods and systems are disclosed for controlling the focus depth of a 2D projected image on a pixel by pixel basis or on a region by region basis to create a 3D projected image that may be used for a heads up display (HUD) for augmented reality applications. The 3D projected image may be overlaid or combined with a 3D real world view using multiple reflective LCD arrays. The multiple reflective LCD arrays may receive a 2D projected image and may generate different length optical paths that may add depth to the 2D projected image to create a 3D projected image. The 3D projected image may be combined with the real world 3D image to create a 3D image encompassing a real world image and a 3D projection image that looks real and contains depth within the image.

BACKGROUND OF THE DISCLOSURE

1. Field of the Disclosure

The disclosure relates generally to methods and systems to control andvary the focus depth of a two-dimensional (2D) projected image on apixel by pixel basis or on a region by region basis to generate athree-dimensional 3D projected image and, in certain embodiments, tomethods and systems for providing a combined viewing image that may bean overlay or a combination with a 3D real world view and an imagegenerated using multiple reflective LCD arrays to generate a 3D imagefrom a 2D projected image for use in a heads-up display (HUD) foraugmented reality applications.

2. General Background

A projected image overlaid onto the eye along with a real world imagesimultaneously to generate a combined image may have a differentdimension associated with each of the input images for use with aheads-up display (HUD) for augmented reality applications. Thesedifferent dimensions from each of the input images may create a 2Dprojected image view along with a 3D image view of the real world thatmay not appear as a homogeneous 3D image.

There is a need in the art to compensate for viewing offset issues whenusing a heads-up display (HUD) for augmented reality applications sothat the eye may be presented a combined image that correctly representsthe images when combined. Depth may need to be part of the image tocorrectly represent the images when combined. One solution may be toconvert the 2D projected image to a 3D image before overlaying the 2Dprojected image onto the 3D real world image by using a 2D to 3D imageconverter so that the image combiner combines two 3D images thereforecombining 2 images that contain depth information within each of theimages. Accordingly, it is desirable to address the limitations in theart. For example, there exists a need to provide for systems and methodsthat may improve the combination of 2D projected images with 3D realworld images to present to the eye simultaneously for heads up display(HUD) application.

BRIEF DESCRIPTION OF THE DRAWINGS

By way of example, reference will now be made to the accompanyingdrawings, which are not to scale.

FIG. 1 depicts a combined image of a 2D projected image with a 3D realworld image as viewed by an eye within a heads-up display (HUD) foraugmented reality applications.

FIG. 2 depicts a combined image of a 2D projected image that has beenconverted to a 3D projected image with a 3D real world image as viewedby an eye within a heads-up display (HUD) for augmented realityapplications in accordance with certain embodiments.

FIG. 3 depicts a 2D projected image and a 3D real world image view thatmay be combined and presented to the eye within a heads-up display (HUD)for augmented reality applications in accordance with certainembodiments.

FIG. 4 depicts a 2D projected image converted to a 3D projected imagecombined with a 3D real world image view and presented to the eye withina heads-up display (HUD) for augmented reality applications inaccordance with certain embodiments.

FIG. 5 depicts a 2D to 3D image converter with different optical lengthpaths of the 2D image projection and presented to the eye within aheads-up display (HUD) for augmented reality applications in accordancewith certain embodiments.

FIG. 6 depicts a 2D projected image converted to a 3D projected imagecombined with a 3D real world image view and presented to the eye withina heads-up display (HUD) for augmented reality applications inaccordance with certain embodiments.

FIG. 7 depicts an image combiner that combines multiple images togetherwithin the heads-up display (HUD) for augmented reality applications inaccordance with certain embodiments.

FIG. 8 depicts a 2D projected image converted to a 3D projected imagecombined with a 3D real world image view and presented to the eye withina heads-up display (HUD) for augmented reality applications inaccordance with certain embodiments.

FIG. 9 depicts a side view of a row of reflective LCD pixel shutterswithin a reflective LCD array programmed to be either reflective ortransparent in accordance with certain embodiments.

FIG. 10 depicts a side view of a row of reflective LCD pixel shutterswithin multiple reflective LCD arrays programmed to be either reflectiveor transparent and a reflective screen in accordance with certainembodiments.

FIG. 11 depicts a top view of a reflective LCD array containingreflective LCD pixel shutters that may be programmed to be eitherreflective or transparent in accordance with certain embodiments.

FIG. 12 depicts a top view of two reflective LCD arrays containingreflective LCD pixel shutters that may be programmed to be eitherreflective or transparent in accordance with certain embodiments.

FIG. 13 depicts a top view of multiple reflective LCD arrays within oneplane containing reflective LCD pixel shutters that may be programmed tobe either reflective or transparent in accordance with certainembodiments.

FIG. 14 depicts a top view of a reflective LCD array containingreflective LCD pixel shutters that may be programmed to be groupedtogether as regions within multiple groupings in accordance with certainembodiments.

FIG. 15 depicts a 2D to 3D image converter for varying the optical pathof the 2D image projection and combining with the 3D real world imageview prior to the image being presented to the eye within a heads-updisplay (HUD) for augmented reality applications in accordance withcertain embodiments.

FIG. 16 depicts a flow chart of an embodiment of the method using a 2Dto 3D image converter in combining multiple images to from a composite3D image within a heads-up display (HUD) for augmented realityapplications in accordance with certain embodiments.

FIG. 17 depicts two 2D projected images converted to 3D projected imagescombined with a 3D real world image view and presented to the eye withina heads-up display (HUD) for augmented reality applications inaccordance with certain embodiments.

DETAILED DESCRIPTION

Those of ordinary skill in the art will realize that the followingdescription of the present invention is illustrative only and not in anyway limiting. Other embodiments of the invention will readily suggestthemselves to such skilled persons, having the benefit of thisdisclosure. Reference will now be made in detail to specificimplementations of the present invention as illustrated in theaccompanying drawings. The same reference numbers will be usedthroughout the drawings and the following description to refer to thesame or like parts.

In certain embodiments, an image combiner system is disclosed,comprising: a 2D image projector; a 2D to 3D image converter forconverting a 2D projected image from the 2D image projector to a 3Dprojected image; and an image combiner for combining the 3D projectedimage with a 3D real world image. The image combiner system may furthercomprise a plurality of 2D to 3D image converters. The 3D projectedimage may comprise at least two focal lengths. The 2D to 3D imageconverter may comprise at least one LCD pixel array and a reflectivescreen. The 2D to 3D image converter may comprise: a first LCD pixelarray with a first focal length; a second LCD pixel array with a secondfocal length; and a reflective screen. The at least one LCD pixel arraymay comprise at least one LCD pixel shutter. The at least one LCD pixelarray may comprise M rows and N columns of LCD pixel shutters. The atleast one LCD pixel array may be programmable to reflect at least onepixel from the 2D projected image away from one of the at least one LCDpixel array. The at least one LCD pixel array may be programmable toreflect at least one group of pixels from the 2D projected image awayfrom one of the at least one LCD pixel array. The at least one LCD pixelshutter may be programmable to permit at least one pixel from the 2Dprojected image to pass transparently through the reflective LCD pixelarray. The at least one LCD pixel shutter may be programmable to permitat least one group of pixels from the 2D projected image to passtransparently through the reflective LCD pixel array.

In certain embodiments, a method of combining images is disclosed,comprising: projecting a 2D image; converting the 2D image to a 3Dprojected image; and combining the 3D projected image with a 3D realworld image. The step of converting may comprise: applying a first focallength to a first one or more pixels of the 2D image; and applying asecond focal length to a second one or more pixels of the 2D image. Thestep of converting may be performed at least in part by at least one LCDpixel array and a reflective screen. The step of converting may beperformed at least in part by: a first LCD pixel array with a firstfocal length; a second LCD pixel array with a second focal length; and areflective screen. The step of converting may comprise: reflecting afirst one or more pixels of the 2D image at a first LCD pixel array toapply a first focal length to the first one or more pixels; andreflecting a second one or more pixels of the 2D image at a second LCDpixel array to apply a second focal length to the second one or morepixels. The step of converting may further comprise reflecting a thirdone or more pixels of the 2D image at a reflective screen to apply athird focal length to the third one or more pixels. The at least one LCDpixel array may comprise M rows and N columns of LCD pixel shutters. Thestep of converting may comprise programming at least one LCD pixelshutter to reflect at least one pixel from the 2D image away from thereflective LCD pixel array. The step of converting may compriseprogramming at least one LCD pixel shutter to reflect at least one groupof pixels from the 2D image away from the reflective LCD pixel array.The step of converting may comprise programming at least one LCD pixelshutter to permit at least one pixel from the 2D image to passtransparently through the reflective LCD pixel array.

In certain embodiments, methods and systems are disclosed forcontrolling the focus depth of a projected image on a pixel by pixelbasis or on a region by region basis to create a projected 3D image thatmay be used for a heads up display (HUD) for augmented realityapplications. The projected 3D image may be overlaid or combined with a3D real world view using multiple reflective LCD arrays. The multiplereflective LCD arrays may receive a 2D projected image and may generatedifferent length optical paths that may add depth to the 2D projectedimage to create a 3D projected image. The 3D projected image may then becombined with the real world 3D image to create a combined 3D imageencompassing a real world image and a converted 2D to 3D projectionimage that contains depth within the image. Other aspects and advantagesof various aspects of the present invention can be seen upon review ofthe figures and of the detailed description that follows.

A 2D projected image overlaid with a 3D image view of the real world mayappear as in FIG. 1. FIG. 1 depicts a person 120 that may be projectedas standing in front of a real world 3D image, such as mountains 110.The combined image may appear as a person standing next to the mountain110 instead of standing further in front of the mountains as may be howthe scene actually should appear. FIG. 1 depicts a 2D projected imageoverlaid or combined with a 3D image view of the real world. Without theuse of 3D conversion techniques on the 2D projected image, the imageswhen blended may not appear correctly and may create viewing offsetissues, such as image depth issues when using a heads-up display (HUD)for augmented reality applications. The viewing offset issues may beimproved by converting the 2D projected image to a 3D image beforecombining it with a 3D image view of the real world. Converting the 2Dprojected image to a 3D image before combining the converted image witha 3D image may allow the combination of the images to be correctlydisplayed without any offset issues by the addition of depth to theoriginal 2D projected image before it is combined with the another 3Dimage.

In certain embodiments, FIG. 2 shows what the image may look like if theprojection of the 2D image is first converted to a 3D image and thenoverlaid or combined with a 3D object. The person 220 may appear to bestanding in front of the mountains 210 at some distance 230 away fromthe mountains in the combined image of FIG. 2 whereas in the combinationof a 2D image with a 3D image as in FIG. 1, the person 120 may appear tobe standing next to the mountain 110. The combination of two 3D imagesmay allow for the image to create depth within the image and allow forthe image to look more realistic to the viewer, or in other words 3D.

In certain embodiments, FIG. 3 shows that an output of a 2D imageprojector 310 and the 3D real world image view 320 may be combined usingan image combiner 330. The output result 345 of the image combiner 330may be a combination of a 2D projection image view output 315 with a 3Dimage view output 320 for the eye 340, which may create viewing offsetissues when using a heads-up display (HUD) for augmented realityapplications. Combining 2D images with 3D images may cause offset issuesin the form of visual depth discrepancies as shown in FIG. 1.

In certain embodiments, FIG. 4 depicts a 2D image projector 410 that mayproject a 2D image 415 to a 2D to 3D image converter 425. The 2D to 3Dimage converter 425 may receive a 2D projected image 415 as an input andoutput a 3D projected image 435. The 3D projected image 435 and the 3Dreal world image view 420 may be combined using an image combiner 430.The result of the image combiner 430 may be a combined a combined 3Dimage 445 that may be presented to an eye 440. Optionally, the combined3D image 445 may be presented to eye 440 using a heads-up display (HUD)for augmented reality applications.

In certain embodiments, the 2D to 3D image converter 425 may convertindividual image pixels from 2D to 3D or regions of image pixels from 2Dto 3D. 2D to 3D image converter 425 may generate a 3D image from a 2Dprojected image by modifying the length of the optical path from theimage projector to the eye.

In certain embodiments, FIG. 5 depicts the modification of the length ofthe optical paths 550. Optical path 530 may be the longest path betweenthe 2D image projector 510 and the eye 540 whereas the optical path 520may be the shortest path between the 2D image projector 510 and the eye540. A system 500 may have any number of different optical length paths550. The optical length paths 550 may travel different lengths togenerate different depths of individual image pixels or regions of imagepixels where a region may be a grouping of image pixels. A region may bedefined as any grouping of two or more individual image pixels withinthe image. The longer the optical path 550, the further away an imagemay be displayed. To generate a 3D image as shown in FIG. 2, the regionof image pixels displaying the person 220 may take the shortest opticalpath 520 between the 2D image projector 510 and the eye 540 since theimage of the person 220 may be closest to the viewer. Whereas theoptical path 550 for the region of image pixels displaying the mountain210 may take the longest optical path 530 between the 2D image projector510 and the eye 540 since the image of the mountain 210 may be thefurthest from the viewer.

In certain embodiments, FIG. 6 depicts an image combiner 630 between theeye 640 and the 3D real world image view 620. The 2D projected imageoutput 660 from the 2D image projector 610 may be received by the 2D to3D image converter 625, where the 2D projected image may be converted toa 3D projected image and output from the 2D to 3D image converter 625.The 3D projected output image 680 may be transferred to the imagecombiner 630 and combined with the 3D real world image view output 670and a combined 3D image 690 may be delivered to the eye 640.

In certain embodiments, FIG. 7 depicts an image combiner 710. The imagecombiner 710 may be an optical device that combines image 1 720 withimage 2 730 into combined image 3 740. The image combiner 710 is notlimited to combining only 2 images. Any number of images may be combinedto produce a combined image 3 740. Therefore, it is understood that theinvention is not to be limited to the specific embodiments disclosed,and that modifications and embodiments are intended to be included asreadily appreciated by those skilled in the art.

In certain embodiments, the image combiner may be a rectangle made fromtwo triangular glass prisms 750 and 760 which may be glued together attheir base 715 using polyester, epoxy, or urethane-based adhesives. Thethickness of the resin layer may be adjusted such that, for a certainwavelength, a portion of the light incident 720 through port 1 780 suchas the face of the cube may be combined with a portion of the lightincident 730 through port 2 790 such as the face of the cube. Theportion of light that is combined from source port 1 780 and from sourceport 2 790 may be transmitted to output port 3 740.

In certain embodiments, FIG. 8 depicts an image combiner 830 with a 2Dto 3D image converter 840 for converting a 2D projected image from the2D image projector 810 to a 3D image. The image combiner 830 combinesthe 3D real world image view 820 with the 2D image projector 810 imageoutput after the 2D image projector image is converted from 2D to 3D andtransfers the combined 3D image 895 to the eye 890. The 2D to 3D imageconverter may comprise a focus optics element 845 and multiplereflective LCD arrays 850 and 855 and a reflective screen 860. Eachreflective LCD array 850 and 855 may selectively reflect an individualpixel or a region (grouping) of image pixels or may be transparent to anindividual pixel or a region (grouping) of image pixels. By closing thereflective LCD pixel shutters of the reflective LCD array 850 and 855the projection for the individual pixel or the region of image pixelsmay be reflected back towards the image combiner 830. By opening thereflective pixel shutters of the reflective LCD arrays 850 and 855, theprojection for the individual pixel or the region of image pixels maypass through the LCD array transparently towards the next reflective LCDin the chain of stacked reflective LCDs or the reflective screen 860which may be the last reflective element in the chain. The opening andclosing of the reflective pixel shutters of the LCD arrays 850 and 855may selectively vary the length of the optical path that a pixel orregion of image pixels may travel. By varying the optical path ofdifferent portions of the 2D projected image from the 2D image projector810 by different amounts, the 2D image may be converted to a 3D image bythe generation of a plurality of different optical focal lengths withinthe image. The focal lengths of the image may be varied to improve thedepth of the picture and create a 3D image from a 2D image. Thereflective screen 860 may be the last reflective element in the chain ofn optical reflective LCDs, where n may be any number greater than one.Any optical path that may be reflected by the reflective screen 860 maybe the longest optical path 880 from the 2D image projector through the2D to 3D image converter. The longest optical path 880 represents thepixels within the image that may be the furthest from the viewer. Anyoptical path that may be reflected by the first reflective LCD 850 inthe chain of optical reflective LCDs may be the shortest optical path885 and represents the pixels within the image that may be the closestto the viewer. FIG. 8 depicts two stacked LCD arrays 850 and 855. One ofordinary skill in the art will recognize that there may be any numbergreater than one of stacked reflective LCD arrays within the 2D to 3Dimage converter. The more stacked reflective LCDs within the 2D to 3Dimage converter may allow for more focal points which may allow for moreaddition of depth content to the converted 2D image to 3D image.Therefore it is understood that the invention is not to be limited tothe specific embodiments disclosed, and that modifications andembodiments are intended to be included as readily appreciated by thoseskilled in the art.

In certain embodiments, FIG. 9 depicts a side view of a row ofreflective LCD pixel shutters 910 of a reflective LCD array within a 2Dto 3D image converter. Each reflective LCD pixel shutter within the rowmay be programmed to be either closed which may be reflective (R) 920 oropen which may be transparent (T) 930. A pixel projected image 940 thatmay be projected to a closed reflective LCD pixel shutter 920 mayreflect the image 960 back towards the focus optics 950 for combinationwithin the image combiner 830. A pixel projected image 970 that may beprojected to an open reflective LCD pixel shutter 930 may allow theimage 970 to transparently transfer the pixel image through thereflective LCD array 910 towards the next reflective element 990. Thereflective LCD pixel shutters may be programmed to be either closed,reflective (R), or open, transparent (T), in any combination so thatdifferent focal lengths may be created to generate depth within theconverted image. The depth addition that may be required may bedependent on the image that may be projected.

In certain embodiments, FIG. 10 depicts a side view of a row ofreflective LCD pixel shutters of multiple reflective LCD arrays 1010 and1090 within a 2D to 3D image converter. Each reflective LCD pixelshutter within a row of reflective LCD arrays 1010 and 1090 may beprogrammed to be either closed which may be reflective (R) 1020 or openwhich may be transparent (T) 1030. A pixel projected image 1040 that maybe projected to a closed reflective LCD pixel shutter 1020 on a firstreflective LCD array 1010 may reflect the image 1060 back towards thefocus optics 1050 for combination within the image combiner 830. A pixelprojected image 1070 that may be projected to an open reflective LCDpixel shutter 1030 on a first reflective LCD array 1010 may allow thepixel image 1070 to transparently transfer the pixel image through thefirst reflective LCD array 1010 and transmit the pixel image 1080towards the second reflective LCD array 1090. The pixel projected image1080 that may be projected to a closed reflective LCD pixel shutter 1020on a second reflective LCD array 1090 may reflect the image 1025 backtowards the focus optics 1050 for combination within the image combiner830.

The second reflective LCD array 1090 containing the reflective LCD pixelshutter 1065 may not reflect or transparently transfer a pixel image tothe next reflective element, such as a reflective screen 1095. This mayoccur since the first reflective LCD array 1010 containing thereflective LCD pixel shutter 1020 may be programmed to be closed whichmay be reflective (R). Since the first reflective LCD array's 1010reflective LCD pixel shutter 1020 may be stacked in front of the secondreflective LCD array's 1090 reflective LCD pixel shutter 1065, which mayblock any pixel image from transferring to the second reflective LCDpixel array's 1090 reflective LCD pixel shutter 1065. Since there may beno image pixel transferred from the first reflective LCD array 1010 tothe second reflective LCD array 1090 for this particular stacked pixelembodiment then the value of the reflective LCD pixel shutter 1065 maybe a do not care (X). Therefore, the reflective LCD pixel shutter 1065may be either closed which may be reflective (R) or open which may betransparent (T).

The reflective LCD pixel shutters may be programmed to be either closed,reflective (R), or open, transparent (T), in any combination so thatdifferent focal lengths for individual image pixels may be created togenerate depth within the converted image. The depth addition that maybe required may be dependent on the image that may be projected.

In certain embodiments, FIG. 10 depicts a side view of a row ofreflective LCD pixel shutters of multiple reflective LCD arrays 1010 and1090 within a 2D to 3D image converter. Each reflective LCD pixelshutter within a row of reflective LCD arrays 1010 and 1090 may beprogrammed to be either closed which may be reflective (R) 1020 or openwhich may be transparent (T) 1030. A pixel projected image 1075 may beprojected to an open reflective LCD pixel shutter 1030 on a firstreflective LCD array 1010, which may allow the pixel image 1075 totransparently transfer the pixel image through the first reflective LCDarray 1010 and transmit the pixel image 1077 towards the secondreflective LCD array 1090. The pixel projected image 1077 may beprojected to an open reflective LCD pixel shutter 1037 on a secondreflective LCD array 1090, which may allow the pixel image 1077 totransparently transfer the pixel image through the second reflective LCDarray 1090 and transmit the pixel image 1079 towards the next reflectiveelement, which may be a reflective screen 1095. The next reflectiveelement, such as a reflective screen 1095 may reflect the incoming pixelimage 1079 to the outgoing pixel image 1035 back towards the focusoptics 1050 for combination within the image combiner 830. In certainembodiments, there may be more levels of stacked reflective LCD arraysto generate more focal lengths of image pixels, which may generate moredepth control of an image. Therefore, it is understood that theinvention is not to be limited to the specific embodiments disclosed,and that modifications and embodiments are intended to be included asreadily appreciated by those skilled in the art.

FIG. 11 depicts a top view of a reflective LCD array 1110 containingreflective LCD pixel shutters that may be programmed to be eitherreflective (R) 1105 or transparent (T) 1115 in accordance with certainembodiments of the present invention. A reflective LCD array containsmultiple rows 1120, 1125, 1130, 1135 and 1140 and multiple columns 1150,1155, 1160, 1165, 1170, 1175 and 1180 of LCD pixel shutters that may beprogrammed individually to be either closed, which may be reflective (R)1105, or open, which may be transparent (T) 1115. The reflective LCDarray may have any number of rows and columns. Therefore, it isunderstood that the invention is not to be limited to the specificembodiments disclosed, and that modifications and embodiments areintended to be included as readily appreciated by those skilled in theart.

In certain embodiments, FIG. 12 depicts a top view of two reflective LCDarrays 1210 and 1290 containing rows and columns of reflective LCD pixelshutters that may be independently programmed to be either reflective(R) 1205 or transparent (T) 1215. The two reflective LCD arrays 1210 and1290 may be stacked within the 2D to 3D image converter to generate a 3Dprojected image. In certain embodiments, a 3D projected image may begenerated by projecting a 2D projected image onto a first reflective LCDarray 1210. If the reflective LCD pixel shutter 1225 is transparent (T),then the pixel image may transition through the reflective LCD arraytransparently towards the second reflective LCD array 1290 in the chainof stacked reflective LCD arrays to generate different length opticalpaths that may create a 3D image which contains depth within theprojected image. The two reflective LCD arrays contain multiple rows1220, 1225, 1230, 1235 and 1240 and multiple columns 1250, 1255, 1260,1265, 1270, 1275 and 1280 of LCD pixel shutters that may be programmedindividually to be either closed, which may be reflective (R) 1205, oropen, which may be transparent (T) 1230. The reflective LCD array mayhave any number of rows and columns. The second reflective LCD array1290 may have more rows and columns than the first reflective LCD array1210. There may be any number of reflective LCD arrays stacked togenerate different length optical paths that may create depth within thecorrected 3D projected image. Therefore, it is understood that theinvention is not to be limited to the specific embodiments disclosed,and that modifications and embodiments are intended to be included asreadily appreciated by those skilled in the art.

In certain embodiments, a reflective LCD array may be made from acombination of more than one reflective LCD within the same plane. Incertain embodiments, FIG. 13 depicts that multiple reflective LCD arrayswithin the same plane may be used in combination to create a 2D to 3Dconversion for the second reflective LCD array 1360 comprising of arrays1320, 1330, 1340, and 1350 whereas one reflective LCD array 1310 may beused for the first plane. Any number of arrays may be used incombination for any plane within the 2D to 3D image converter. Eachreflective LCD array 1310, 1320, 1330, 1340, and 1350 as shown in FIG.13 may also be a different physical size and may also contain adifferent number of reflective LCD pixel shutter rows and columns.Therefore, it is understood that the invention is not to be limited tothe specific embodiments disclosed, and that modifications andembodiments are intended to be included as readily appreciated by thoseskilled in the art.

In certain embodiments, FIG. 14 depicts regions 1420, 1430, 1440, 1450,and 1460 of reflective LCD pixel shutters that may be programmed to begrouped together. A region may be any grouping of two of more imagepixels. A region may be a group of reflective LCD pixel shutters thatmay have the same reflective LCD pixel shutter position. Each reflectiveLCD pixel shutter position within the region may either be programmed tobe closed, which may be reflective (R) 1470, or open, which may betransparent (T) 1480. This may allow the image pixels associated with aparticular region to traverse the same number of reflective LCD arraysso that the focal length for all the image pixels within the region(group) may be the same. This may allow for programming and controllingthe depth of each region (group) independently. There may be manydifferent groupings within a reflective LCD array for controlling thefocal length. Each of the groupings 1420, 1430, 1440, 1450, and 1460 maybe a different size, may contain a different number of reflective LCDpixel shutters, and may have a different shape as depicted in FIG. 14.There may be many regions of reflective LCD pixel shutters as well asindividual reflective LCD pixel shutters programmed to be closed, whichmay be reflective (R) 1495, or open, which may be transparent (T) 1490,for controlling the focus depth of a projected image on a pixel by pixelbasis or on a region by region basis to create a 3D image, for exampleand without limitation for a heads up display (HUD) for augmentedreality applications. The 2D to 3D image converter may be programmed toconvert individual image pixels from 2D to 3D or regions of image pixelsfrom 2D to 3D or any combination of individual pixels and regions ofimage pixels. In certain embodiments, different portions of a 2Dprojected image may travel different paths and lengths to generatedifferent depths of individual image pixels or regions of image pixelsto generate a 3D image. Therefore, it is understood that the inventionis not to be limited to the specific embodiments disclosed, and thatmodifications and embodiments are intended to be included as readilyappreciated by those skilled in the art.

In certain embodiments as shown in FIG. 15 a 2D image projector 1510 mayproject a 2D image 1515 to focusing optics 1525 which may be part of a2D to 3D image converter. Focusing optics 1525 may focus image pixelsfrom the 2D image projector through different multiple optical paths, a1^(st) optical path 1550, a second optical path 1555, through a nthoptical path 1560, where the nth optical path 1560 may be the lastoptical path. The 1^(st) optical path 1550 may be the shortest opticalpath, the 2^(nd) optical path 1555 may be the next longest optical path,and so on until the longest optical path, the nth optical path 1560.There may be any number of different optical length paths. The opticallength paths may travel different lengths to generate different depthsof individual image pixels or regions of image pixels. A region may beany grouping of two or more individual image pixels within the image. Incertain embodiments, the longer the optical path 1560 the further awayan image may appear when displayed. In certain embodiments, the shorterthe optical path 1550 the closer an image may appear when displayed. The3D image combiner may combine all of the converted 2D projected imagepaths 1550, 1555 . . . 1560 with the 3D real world image view 1535 andpresent the combined image 1545 to the eye 1540. In certain embodiments,the 3D image combiner 1530 may overlay a 3D projected image view fromthe multiple paths 1550, 1555 . . . 1560, with a 3D real world imageview 1535 creating a combined 3D image 1545 for a heads-up display (HUD)for augmented reality applications.

In certain embodiments, the flow chart of FIG. 16 depicts a method usingan image combiner with a 2D to 3D image converter that may combine a 3Dreal world image view with a 2D projected image that may be convertedfrom 2D to 3D prior to being combined. The 2D projection image 1610 mayenter the combining optical component 1625 that may combine a real worldimage with a projected image and be transmitted to the image pixelfocusing optics 1630 where the 2D projected image may be split intoindividual image pixels and directed to the 1^(st) reflecting ortransparent image LCD pixel shutter 1640. If the LCD pixel shutter for aparticular region or a particular pixel is programmed to be reflectivethen that particular part of the image may be sent back along the path1645 to the image combiner 1625 for combination with the 3D real worldimage 1620. If the 1^(st) reflecting or transparent image LCD pixelshutter 1640 is programmed to be transparent for a particular region ora particular pixel then the particular region or particular pixel may besent to the 2^(nd) reflecting or transparent image LCD pixel shutter1650. If the LCD pixel shutter for the 2^(nd) reflecting or transparentimage LCD pixel shutter 1650 for a particular region or a particularpixel is programmed to be reflective then that image may be sent backalong the path 1655 to the image combiner 1625 for combination with the3D real world image 1620. If the 2^(nd) reflecting or transparent imageLCD pixel shutter 1650 is programmed to be transparent for a particularregion or a particular pixel then that the particular region orparticular pixel may be sent to the reflecting projection screen 1660where a particular region or a particular pixel may be sent back alongthe path 1665 to the image combiner 1625. There may be more than tworeflecting or transparent shutter arrays to create more focal lengths.Therefore, it is understood that the invention is not to be limited tothe specific embodiments disclosed, and that modifications andembodiments are intended to be included as readily appreciated by thoseskilled in the art.

In certain embodiments, FIG. 17 depicts two separate 2D projectors 1750and 1710 along with two 2D to 3D image converters 1760 and 1725. FIG. 17depicts a first 2D image projector 1710 that may project a 2D image 1715to a first 2D to 3D image converter 1725. The first 2D to 3D imageconverter 1725 may take a first 2D projected image 1715 as an input andoutput a first 3D projected image 1735. A second 2D image projector 1750may project a 2D image 1755 to a second 2D to 3D image converter 1760.The second 2D to 3D image converter 1760 may take a second 2D projectedimage 1755 as an input and output a second 3D projected image 1765. The3D projected images 1735 and 1765 may be combined with a 3D real worldimage view 1720 using an image combiner 1730. In certain embodiments,the image combiner 1730 may overlay or combine the first 3D projectedimage view 1735 and the second 3D projected image view 1765 with the 3Dreal world image view 1720 to create a combined 3D image 1745 for aheads-up display (HUD) for augmented reality applications. Any number of2D image projectors with one or more 2D to 3D image converters may beencompassed within the invention. Therefore, it is understood that theinvention is not to be limited to the specific embodiments disclosed,and that modifications and embodiments are intended to be included asreadily appreciated by those skilled in the art.

While the above description contains many specifics and certainexemplary embodiments have been described and shown in the accompanyingdrawings, it is to be understood that such embodiments are merelyillustrative of and not restrictive on the broad invention, and thatthis invention is not limited to the specific constructions andarrangements shown and described, since various other modifications mayoccur to those ordinarily skilled in the art, as mentioned above. Theinvention includes any combination or subcombination of the elementsfrom the different species and/or embodiments disclosed herein.

I claim:
 1. An image combiner system, comprising: a 2D image projector; a 2D to 3D image converter that receives a 2D projected image from the 2D image projector and converts the 2D projected image to a 3D projected image; and an image combiner that receives the 3D projected image from the 2D to 3D image converter and combines the 3D projected image with a 3D real world image; wherein the 2D to 3D image converter comprises a reflective LCD pixel array and a reflective screen, the reflective LCD pixel array positioned in front of the reflective screen relative to the 2D image projector to initially receive the 2D projected image from the 2D image projector, and the reflective LCD pixel array comprises a plurality of LCD pixel shutters, each of the LCD pixel shutters is programmable to either a closed position where the LCD pixel shutter is reflective and reflects a portion of the 2D projected image toward the image combiner, or an open position where the LCD pixel shutter is transparent and passes a portion of the 2D projected image toward the reflective screen to be reflected thereby toward the image combiner, such that portions of the 2D projected image reflected by the LCD pixel shutters have a shorter optical path length than portions of the 2D projected image reflected by the reflective screen to convert the 2D projected image into the 3D projected image provided to the image combiner.
 2. The image combiner system of claim 1, wherein the reflective LCD pixel array is a first reflective LCD pixel array, and the 2D to 3D image converter comprises: a second reflective LCD pixel array positioned in front of the first reflective LCD pixel array, the second reflective LCD pixel array comprising a plurality of LCD pixel shutters, each of the LCD pixel shutters is programmable to either a closed position where the LCD pixel shutter is reflective and reflects a portion of the 2D projected image toward the image combiner, or an open position where the LCD pixel shutter is transparent and passes a portion of the 2D projected image toward the first reflective LCD pixel array.
 3. The image combiner system of claim 1, wherein the reflective LCD pixel array comprises M rows and N columns of LCD pixel shutters.
 4. The image combiner system of claim 2, wherein the 2D to 3D image converter comprises: a third reflective LCD pixel array positioned in front of the second reflective LCD pixel array, the third reflective LCD pixel array comprising a plurality of LCD pixel shutters, each of the LCD pixel shutters is programmable to either a closed position where the LCD pixel shutter is reflective and reflects a portion of the 2D projected image toward the image combiner, or an open position where the LCD pixel shutter is transparent and passes a portion of the 2D projected image toward the second reflective LCD pixel array.
 5. The image combiner system of claim 1, wherein each of the plurality of LCD pixel shutters is programmable to reflect at least one group of pixels from the 2D projected image.
 6. The image combiner system of claim 1, wherein each of the plurality of LCD pixel shutters is programmable to permit at least one pixel from the 2D projected image to pass transparently through the reflective LCD pixel array.
 7. The image combiner system of claim 1, wherein each of the plurality of LCD pixel shutters is programmable to permit at least one group of pixels from the 2D projected image to pass transparently through the reflective LCD pixel array.
 8. The image combiner system of claim 1, wherein the image combiner comprises two triangularly shaped prisms coupled together.
 9. The image combiner system of claim 1, wherein the 2D to 3D image converter includes a focus optics element positioned in front of the reflective LCD pixel array.
 10. The image combiner system of claim 1, wherein each LCD pixel shutter of the plurality of LCD pixel shutters selectively reflects or passes a single pixel of the 2D projected image.
 11. The image combiner system of claim 1, wherein each LCD pixel shutter of the plurality of LCD pixel shutters selectively reflects or passes a group of pixels of the 2D projected image.
 12. A method of combining images, comprising: projecting a 2D image; converting the 2D image to a 3D projected image; and combining, via an image combiner, the 3D projected image with a 3D real world image; wherein the converting is performed at least in part by a reflective LCD pixel array and a reflective screen, the reflective LCD pixel array positioned in front of the reflective screen and comprises a plurality of LCD pixel shutters, each of the LCD pixel shutters is programmable to either a closed position where the LCD pixel shutter is reflective and reflects a portion of the 2D projected image toward the image combiner, or an open position where the LCD pixel shutter is transparent and passes a portion of the 2D projected image toward the reflective screen to be reflected thereby toward the image combiner, such that portions of the 2D projected image reflected by the LCD pixel shutters have a shorter optical path length than portions of the 2D projected image reflected by the reflective screen to convert the 2D projected image into the 3D projected image provided to the image combiner.
 13. The method of claim 12, wherein the reflective LCD pixel array comprises a first reflective LCD pixel array, and the converting is performed at least in part by: a second reflective LCD pixel array positioned in front of the first reflective LCD pixel array, the second reflective LCD pixel array comprising a plurality of LCD pixel shutters, each of the LCD pixel shutters is programmable to either a closed position where the LCD pixel shutter is reflective and reflects a portion of the 2D projected image toward the image combiner, or an open position where the LCD pixel shutter is transparent and passes a portion of the 2D projected image toward the first reflective LCD pixel array.
 14. The method of claim 13, wherein the converting is performed at least in part by: a third reflective LCD pixel array positioned in front of the second reflective LCD pixel array, the third reflective LCD pixel array comprising a plurality of LCD pixel shutters, each of the LCD pixel shutters is programmable to either a closed position where the LCD pixel shutter is reflective and reflects a portion of the 2D projected image toward the image combiner, or an open position where the LCD pixel shutter is transparent and passes a portion of the 2D projected image toward the second reflective LCD pixel array.
 15. The method of claim 12, wherein the plurality of LCD pixel shutters comprises M rows and N columns of LCD pixel shutters.
 16. The method of claim 12, wherein the converting programming at least one of the plurality of LCD pixel shutters to reflect at least one pixel from the 2D image away from the reflective LCD pixel array.
 17. The method of claim 12, wherein the converting programming at least one of the plurality of LCD pixel shutters to reflect at least one group of pixels from the 2D image away from the reflective LCD pixel array.
 18. The method of claim 12, wherein the converting programming at least one of the plurality of LCD pixel shutters to permit at least one pixel from the 2D image to pass transparently through the reflective LCD pixel array. 